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Abstract 

We obtain necessary optimality conditions for higher-order infinite horizon problems of the calculus of 
variations via discrete quantum operators. 
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1. Introduction 

Quantum difference operators are receiving an increase of interest due to their applications in physics, 
economics and the calculus of variations — see lUl S S B IH and references therein. Here we develop the 
quantum variational calculus in the infinite horizon case. Let q > \ and denote by Q the set Q :- - 
[q" : n € No}. In what follows cr denotes the function defined by cr(f) :- qt for all t e Q. For any A: e N, 

■= (T o cr'^"\ where cr" = id. It is clear that cr*(r) = q'^t. For / : (3 — » M we define := / o cr*. Fix 
a & Q and r € N. We are concerned with the following higher-order ^-variational problem: 



J(x(-)) = L[t,{xo cr'-)(f), Dq[x o (r^-i](f), . . • , D'-^-'[x o cr](f), D[[x]{t)) dgt max 

J a 



(1) 



x(a) = ao, Dg[x](a) - a\, ... '[-^Ka) = oi,-\. 



where (u\,. . Ur, Wr+i) —> L(t, ui, . . . , Wr+i) is a C^K'^^', K) function for any t e Q, and uq, . . . , a^-i are 
given real numbers. The results of the paper are trivially generalized for the case of functions x . W, 
n e N, but for simplicity of presentation we restrict ourselves to the scalar case, i.e., n - 1. In Section|2] 
we present some preliminary results and basic definitions. Main results appear in Section |3] in ^3.1l we 
prove some fundamental lemmas of the calculus of variations for infinite horizon g'- variational problems; 
an Euler-Lagrange type equation and transversality conditions for ([T]i are obtained in \ 



2, Preliminaries 

Let / be a function defined on Q. By Dq we denote the Jackson <7-difference operator: 

DqUm :^ ^^f " f Wea (2) 
(q- l)f 

The higher-order q'-derivatives are defined in the usual way: the rth ^-derivative, r e N, of / : (3 — » K is 
the function : Q ^ R given by := [/]], where D%f] := /. 

The Jackson ^-difference operator (|2| satisfies the following properties. 
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Theorem 1 (cf. t^). Let f and g be functions defined on Q and t € Q. One has: 
1. Dq[f] = on I if and only if f is constant; 



2. D,lf + g](t)^D,[f](t) + Dg[g](t); 

fg] it) = D, [/] (f) g{t)+f iqt) D, [g] it), 
f 



3. Dg 



4. 



D,[f]it)git)-fit)D,[g]it) 

it) = 77n~T^ ifgit)giqt) + 0. 



Let fl € (3 and h \- aq" e Q for some « e N. The ^'-integral of / from a to bis defined by 



/ 

Ja 



h n-1 

fit)dqt := fl(^ - 1) 2 q^fiaq^). 

k=0 



Theorem 2 (cf. 16]). If a, b, c e Q, a < c < b, a,f3 e R, and f, g : Q ^ R, then 

rh , ^, ^ „ , , rb ^, , , „ rb 



1. I iafit)+/3git))dgt^al fit)dgt+/3l git)dgt; 

2. fit)dgt ^ - £ fit)dgt; 

3. £fit)d,t = 0; 

4. fit)dgt = £ fit)dgt + £ fit)dgt; 

rb 

5. If fit) > Q for all a < t < b, then fit)dqt > 0; 

6. £ fit)Dq[g]it)dqt = [/(f)^(0]Sa - X* ^qU'\i')giqt)dqt (q-integration by parts formula); 

rb 

7. Dq[f'\it)dqt — fib) — fia) (fundamental theorem of q-calculus); 

8. Dq[£ fiT)dqT\it) ^ fit). 

As usual, we define 

fit)dqt:^ lim /(Oc/^f 

provided this limits exists (in M := M U {-oo, +oo}). We say that the improper ^-integral converges if this 
limit is finite; otherwise, we say that the improper ^'-integral diverges. 

In what follows all intervals are q'-intervals, that is, for a,b e Q, {a,b} :- {t e Q : a < t < b] and 
[a, +oo[:= {t eQ : a < t < +oo). 

Definition 1. We say that x : [a, +oo[—^ R is an admissible path for problem ([TJ if xia) - ao,Dq[x]ia) - 
ai,...,D'f^[x]ia) = Or-i. 

There are several definitions of optimality for problems with unbounded domain (see, e.g., ll3,BS[i3l)- 
Here we follow Brock's notion of optimality. 

Definition 2. Suppose that a, T,T' e Q are such that T' > T > a. We say that x, is weakly maximal to 
problem ([TJ if and only if x, is an admissible path and 



lim 

T 



m inf I 

+O0 T'>T J„ 



Lit, ix o (rO(f), Dq[x o (T'-'m, . . . , [X o cr](f), £»;[x](f)) 



- Lit, ix, o cT'-)it), Dq[x, o (T'-^m, [x. o cr](f), £»;[x.](f)) 



dqt < 



for all admissible x. 

Note that in the case where the functional J' of problem ([T]i converges for all admissible paths, the weak 
maximal path is optimal in the sense of the usual definition of optimality. However, if every admissible 
function x yields an infinite value to the functional, using the usual definition of optimality each admissi- 
ble path is an optimal path, showing that the standard definition is not appropriate for problems with an 
unbounded domain. 

Lemmas [T] and |2] are an immediate consequence of the definition of Jackson ^-difference operator. 
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Lemma 1. For anyf:Q-^R and t e Q, Dq[f](o-(t)) = ^Dq[f o o-](f). 

Lemma 2. Assume rj : [a, +oo[— > M is such that D[^{Tf\{a) - Q for all i - . . . ,r. Then, D'^^ [rioo-](a) - 
for each i = I, . . .,r. 

The following basic result will be useful in the proof of our main result (Theorem|4|. 

Theorem 3 (cf. il 111 ). Let S and T be subsets of a normed vector space. Let f be a map defined onT x S, 
having values in some complete normed vector space. Let v be adherent to S and w adherent to T. Assume: 

1 . limv->v f(t, x) exists for each t e T; 

2. lim,^H. f{t, x) exists uniformly for x e S . 

Then the limits lim,^„ lim v^i. f(t, x), lim v^i. lim,^^. f(t, x), and li'n\t,x)^(w,v) fit, x) all exist and are equal. 



3. Main results 



Before proving our main result (TheoremlH, we need several preliminaries results. Namely, we prove 
in ^3.11 a higher-order ^-integration by parts formula and three higher-order fundamental lemmas for the 
^-calculus of variations. 

5.7. Fundamental lemmas 

In our results we use the standard convention that YJk=\ 'y(^) - whenever j - 0. 

Lemma 3 (Higher-order ^-integration by parts formula). Let r e N, a,b e Q, a < b, f,g : [a, cr'^ib)] —> R. 
For each i — \,2, . . . ,r we have 



£ f(t)D'^[g°cr'-'md,t^(-iy £ |ij " D'^[f]it)g''\t)d,t 

i-1 k , 

+ f(t)D'^-' [g o (t'-'KO + 2(-l)*D^[/](f)Z);-'-n§ o cr^-'^'](t) ■ n - 



'-J 



Proof. We prove the lemma by mathematical induction. If r = 1, the result is obviously true from the 
^-integration by parts formula. Assuming that the result holds for degree r > 1, we will prove it for r + I. 
Fix some i - 1,2, . . .,r. By the induction hypotheses, we get 



f{t)D[{go(r'^'--](t)dqt^ /(f)£>;[^"°cr'-'](fM,f 

J a J a 

-1 



+(-1)' 



f(t)D'^-'[g o cr'^'-'m + |](-l)'^£'^[/](OZ);-'-n^ o (r^+i--*](f) - ]^ [i 

/t=l ;=1 



I- J 



(-1)' 



'[/](%" (t)d,t. 



It remains to prove that the result is true for i - r + 1. Note that 



r fim^^'igmd^t ^ r f{t)D[[D,[gm)d, 

Ua J a 



f 



-lb 



and, by the induction hypotheses for degree r and i = r, 

h ''I'-') 

[^KOV = (- £ (^) D'-^[f](t)D,[g]icr'(t))d,t 

r-l . , 

From Lemma[T]we can write that 

/(oz);M(o+2(-i)'^?[/]«^r'[^°'^]«-(^) n(^) ' 



f 



fim^'igmdct ■ 



k=\ 



and, by the ^-integration by parts formula, 

r mD[^'[g]{t)d,t = mD[[g]{t) + Yj^-^fDimm^-^g □ c/m ■ f\ (- 



k=\ 



;=1 



(-iyD;[/](f)g- (f)|- 



(-ly 



We conclude that 



r 



+ j](-i)'£»^[/](f)£'r*[^ ° c^](o ■ n (- 

k=l j=l 

, r(i-tl) 



+ {-iy 



proving that the result is true for i - r + 1. □ 

The following lemma follows easily (by contradiction and the properties of the q'-integral). 
Lemma 4. Suppose that a e Q and f : [a, +oo[— > M is a function such that f > 0. If 

lim inf f f(t)d,t^O, 

T^+cx,T'>T 

then f — on [a, +oo[. 

We now present two first-order fundamental lemmas of the g'-calculus of variations for infinite horizon 
variational problems. 

Lemma 5. Let a eQ and f : [a, +oo[^ K. If 



lim inf ( 

T^+oo T'>T J„ 



f{t)Dq\ri\{t)dqt — for all rj : [a, -i-oo[— > M such that rj(a) — 0, 



then f{t) — c for all t 6 [a, +oo[, where c e ]R. 
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Proof. Fix T,T' e Q such that T' > T > a. Let c be a constant defined by the condition 

r (/(t)-c)v=o 

Ja 

and let ^ 

?7(o= r (/(t)-c)v- 

Clearly, D^[?7](f) = /(f) - c and 

->T' 

r](a)^ I (/(t)-c)V = and 77(7')= I (/(t)-c)V = 0- 



Observe that 



r (/(t)-c)V = and 77(n= f 

Ja -Ja 

r (/(f)-c)D,[77](fw,f= r (m-cfd,t 



and 
Hence, 

lim inf | f{f)Da\rj\{t)dat - lim inf ( ( f(f) - c)^ <iof = 0, 

P^r Jn r^+oo T'>T J a 

which shows, by LemmaH] that /(?) - c - Q for all t e {a, +oo[. □ 
Lemma 6. Let f,g : [a, +oo[— > M. 



^Ihn^ mf r (/(0'7(?f) + ^(f)£»?[/7](0) d^t = 



for all Tj : [a, +oo[— > M such that T](a) — 0, then Dq[g](t) — f(t)for all t 6 [a, +oo[. 

Proof Fix T,T' e Q such that T' > T > a and define A(0 = £ f(T)dqT. Then /),[A](?) = /(O for all 
t e [a, +oo[ and 

r A(f)£>,[/7](fM?f = [A(f)'7(f)]r - r Dg[Ami](qt)d,t ^ A(T'),j(T') - [ f(t)T](qt)dgt. 

<Ja 



Restricting 7/ to those such that ri{T') - 0, we obtain 
lim inf | 

T 



lim inf r {f{t)ri{qt)+g(t)Dq[Ti\(t))dqt^ lim inf f (-A(f) + g(f)) = 0. 



By Lemma |5] we may conclude that there exists c e K such that -A(t) + g(t) - c for all f e [a,+oo[. 
Therefore, Dq[A](t) = £>^[g](0 for all t 6 [a, +oo[, proving the desired result. □ 

Lemma 7 (Higher-order fundamental lemma of the g'-calculus of variations I). Let fo, fi, . . . ,fr : [a, +oo[— > 



lim inf yfit)D'^[7locr^-']it) 



t/^f = 



for all 77 ; [a, +oo[— > M 5mc/i that rjia) — 0, D^[77](a) — 0, . . . , D'^ ' [t/Ka) = 0, then 



g(-iyy £»;[/;](f) = Vfe[«,+cx,[. 
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Proof. We proceed by mathematical induction. If r - 1, the resuh is true by Lemma |6] Assume that the 
result is true for some r > 1 . We prove that the result is also true for r + 1 . Suppose that 



-,7" / r+\ 



dqt^O 



for all ?7 : [a, +oo[-> M such that 77(0) = 0, Dq[T]](a) -0, D'Jri]{a) - 0. We need to prove that 



( -) ' D'^lMt) = Vf € [a, +(x,[. 



!=0 



Note that 

-7' / r+l 



V 1=0 



dqt 



•J a \ :n 



V /={) 



fi(t)D'^[T1oa'^'-'](t)\d,t + \ Ui(t)D,[D'-^[j]]](t)d,t 



f 

J a 



Using the ^-integration by parts formula in the last integral, we obtain that 

r /.+i(f)£>j-D;[/7]](fHf = [/r+i(f)-D;['?](o]„^'- r D,{,ui]imq{ii]{qf)d, 

J a J a 

Since = and we can restrict ourselves to those rj such that D^^[rf\(T') - 0, then 

r fr^i(t)D,[D[[i^]]{t)d,t ^ - r D,[/,+i](f)£>;[77](cr(f)Hf. 

By Lemma[Tl 

£ /;.+i(f)£>J£>^[;?]](OV = -£ D,[/,+i](f)(ij o(r](f)V- 



Hence, 



J ^7" f r+l 
2/;(f)Z);[7;ocr'+'-'](f) 
13 ,-11 



dqt 



•J a J J a \?/ 



and, therefore. 



lim 

T->+oo T 



dqt 



y fi{t)D[{ii'' o cr-'KO + \m - Dq[f, 



,+i](f)(-| )£»J[77ocr](f) 



dqt = 0. 



By Lemma|2] rf{a) - 0, Dq{ri o cr](fl) = 0, . . . , '[770 cr](fl) = 0. Then, by the induction hypothesis, we 
conclude that 



y ^ ^;[/](o - (-1)'-^ ^ ^; 



(0 = Vf6[a,+oo[, 



which is equivalent to (i) ' £>^^[./;](0 = for all t e [a, +oo[. 
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□ 



Lemma 8 (Higher-order fundamental lemma of the g'-calculus of variations II). Let f^, f\, . . . , : [a,+oo[- 



Um inf yji{t)D\{r,ocr'-']{t) , 

/or flW // : [a, +oo[— > M 5mc/i f/zaf rjia) — 0, D^[77](a) = 0, . . . , D^"' = 0, f/zen 

lim inf {/,(r)-Dj-i[7,](r)U0. 

Proo/. Note that 

r [2/i«£>;[77°cr'-'](fMJ= r /o(0'7"'(fHf + X( r ./:(0£»;[/7ocr-'](fM, 

J a ) J a ,.^[ Wfl 

T' ^ ( T' I 

+ ^ .mDi;'[n o cr"](0 + |](-l/Z)^[/;](f)Z)r'-'[^ ° cr""*](f) ■ (i 

1=1 L k=l j=l 



dgt = 



r f i-l /t / , 



1=1 



Vi=0 

-1 r/' 



it=i 



'■=1 Lv A=i 

r-l k 1^ 



7" 



where in the second equality we use Lemma[3] Applying now Lemma|2]we get 



i=0 

r-l 



r-i 1-1 K / 1 \ 

;=i Lv it=i i=i 

r-l k , 



*:=1 



r 



Therefore, restricting the variations 77 to those such that 



we get 



D\-\ri o o-'-'']{T') = D*-'[/7ocr'-*](fl) = 0, V;t = 1, 2, . . . , r - 1, 
D[-^-''[ri o (/]{T') = D;-'-*[77 (/](a) = 0, Vfe = 1, 2, . . . , r - 1, 



r""' r'P/r /;«ij;[?7 ° ^^"1 w] - ^ lim inf {/.(DD-' ^(n} = 

T—>+ooT'>T 1^, ^ — * ^ T—>+coT'>T^ ^ ' 



proving the desired result. 



□ 



Lemma 9 (Higher-order fundamental lemma of the ^-calculus of variations III). Letfo,fi , . . . , fr : [a, +oo[- 
R.If 



lim ipf r {yMt)D'^[r,o<Tn(t) 



dgt = 



for all r] : [a, +oc[—> M such that rjia) — 0, Dq[rj\(a) — 0, . . . , D'^ ' = 0, then 



lim inf < 

T^+co T'>T 



k-\ i I -.Y-(k-\)H.i-l)\ "I 

I i=l j=l ) I 



for k — 1,2, . . .,r. 

Proof. We prove the lemma by mathematical induction. For r - 1, using the q'-integration by parts formula 
and Lemma |7] we obtain lim7-^+ooinf7'>7-/i(7"')'?(7^') = 0, showing that the result is true for r = 1. 
Assuming that the result holds for degree r > 1, we will prove it for r + I. Suppose that 



T' { r+1 



r— >+oo T'>T 1^ ^ — J ^ 



dqt = 



for all T] : [a, +oo[-> M such that T](a) - 0, Dq[ri](a) - 0, . . . , D''g[T]](a) - 0. We need to prove 



lim inf 

T-^+co T'>T 



fr^i-ik-i)(T') + Y,(-'^yDij[Ui-(k-r>^i](T') ■ Yl {-] 

i=l M 



i I -, ^r+\-(k-\)+U-\)\ 

1 

>1 



■D;+'-*[;7O(/-i](r)U0 (3) 



for k - 1 , 2, . . . , r, r + 1 . Fix some k - 2, . . . ,r,r + \. The main ideia of the proof is that the A;-transversality 
condition for the variational problem of order r + 1 is obtained from the k - \ transversality condition for 
the variational problem of order r. Using the same techniques as in Lemma|71 we prove that 



„j' f r+l 

1™ Y. mD[[ijocT'--'-'](t) 

—*+ooT'>T /„ ^ — ^ ^ 



V!=0 



lim inf < 

T^+oo T'>T 



dqt - 



„r ( r-l 



o tr-'KO + [frit) - D,[frM {-]] D[[ti o am 



dqt } - 0. 



Since, by Lemma|2] rf{a) - 0, Dq[ri o cr\{a) - Q, . . . , D''^ ' [77 o cr](fl) = 0, then, by the induction hypothesis 
for k— 1 , we conclude that 

inf {(/.-(.-2)(r') + 2(-i)'^^[/-(^-2H,](r') . n (^) 



7=1 



1 Y-ik-2)+U-\) 



k-2 



Kr-(*-2)+(;-I) 



+(-i)*-2D*-2[/,](r)-pj(-)'' 



which is equivalent to 



lim inf <j 

r^+co T'>T 



fr-(k-2)iT') + £(-l)'Z);[/,_(,_2)+,](r') ■ f] (-) 
,= 1 ;=1 



i /. ^M^2)+0■-l)^ 



and proves equation (O for = 2, 3, . . . , r, r + L It remains to prove (O for ^ = 1. This condition follows 
from Lemma [8] □ 



3.2. Euler-Lagmnge equation and transversality conditions 

We are now in conditions to prove a first-order necessary optimality condition for the higher-order 
infinite horizon <7-variational problem. In what follows (9,L denotes the partial derivative of L with respect 
to its /th argument. For simplicity of expressions, we introduce the operator (■) defined by 

{x){t) (f, {X o (rO(f), D,[x o cr-' ](f), ...,£>-' [x o cr](f), £>; W(f)) ■ 

Theorem 4. Suppose that the optimal path to problem ([T) exists and is given by x«. Let rj : [a, -i-oo[— > R 
be such that rjia) - 0, Dq[ri](a) = 0, . . . , D'y^[T]](a) - 0. Define 



A{s, T') 

V(s, T) 
V{s) 



L<x. + eT])(t) - L{x,)(t) 



= 1 ^ 

= inf I (L<x, -I- e7i)(t) - L(;c,)(f)) dgt, 

T'>T J„ 



lim V(e,T). 



Suppose that 

1. Iime_,o exists for all T; 

2. limj-^+oo ^^^^ exists uniformly for e; 

3. ForeveryT' > a, T > a, ande E M\{0), there is a sequence {A(e,Tlj))^^fgj suchthat]im„^+tx,A(E,Tlj) = 
inf7-'>7 A(e, T') uniformly for s. 

Then Xt satisfies the Euler-Lagrange equation 



D[^[di^2L{x)]{t)^Q 



(4) 



for all t e [a, +oo[, and the r transversality conditions 



lim inf < 

7"->+oo T'>T 



Or+2-{k- 



D-*[xocr*-'](r) =0, (5) 



/fc = 1, 2, . . . , r, where = n;=i (^) 



jy-(t-I)+a-I) 



Proof. Using the notion of weak maximality, if x, is optimal, then V{e) < for every e e M. Since 
y(0) = 0, then is an extremal of V. We prove that V is differentiable at f = 0, hence V'CO) - 0. Note that 

y (0) = lim = lim lim 

£->o e £^0 7'->+t)o g 

y(e, r) 

= lim lim — (by hypothesis 1 and 2 and Theorem[3]l 

= lim lim inf A(£, T') 

= lim lim lim A(e, T,') (by hypothesis 3) 

= lim lim lim A(e,r,') (by hypothesis 5 and Theorem[3]l 

r^+co n— >+oo e— >0 

= lim inf lim A(£, r') (by hypothesis 5) 

T^+coT'>T e^O 



- lim inf lim ( 

T^+co T'>Te^O 

- lim inf I 

T^+o. T'>T X 



L<x, + erf)(t) -L(x,>(f) 



lim dgt 



lim inf f [y 5,+2i<x.>(f)-D;[/7ocr"Kf) 



and hence 



Using Lemma|2]we conclude that 



dqt - 0. 



d; [di^2L{x.)] (t) = 



for all f e [a, +oo[, proving that x» satisfy the Euler-Lagrange equation (HJl. By Lemma|9] for k - 1 , 2, . . . , r, 



lim inf \ 

T^+oa T'>T 



k-l 



d,-^2-(k-i)L{x,)(T') + ^(-1)'£>; [dr^2-(k-i)^iL{x,)] (T') ■ 



D:^-'[rjocr'-']{T')\^Q, (6) 



where T, = n;=i j ■ Consider defined by 77(f) = a(f)Xt(f), t e [a, +oo[, where a : [a, +oa[- 

R satisfy a(a) = 0, Dg[a](a) ^0,...,D''-^ [a](a) = 0, and there exists To e Q such that a(t) = /? G K \ (0) 
for all f > To. Note that 77(a) = Q,Dg[j]]{a) = 0, . . . , D^"'[77](a) - 0. Substituting 77 in equation (|6| we 
conclude that 



lim inf < 



■D:^-'[x,oa'-'](T')\^0, 



dr^2-(k-i)LM(T') + Yj^-'^YD'y [dr+2-(k-iHiLM] (T') ■ 

VV 1=1 / 

proving that x, satisfy the transversality condition (|5]l for all = 1, 2, . . . , r. □ 
Remark 1. For the simplest case r = 1 we obtain from Theorem|4]the Euler-Lagrange equation 
D, [s ^ d3L{s,xiqs),D,[x](s))](t) = d2L{t,x(qt),D,[x](t)) 

and the transversality condition limj-^+oo inf 7-'>7- ^d^L (t', x{qT'), Dq[x]{T')^ ■ x{T')^ = 0. However, when 
r > 1, Theorem |4] gives more than one transversality condition. Indeed, for an infinite horizon variational 
problem of order r one has r transversality conditions and, for each k - 1 , 2, . . . , r, the ^th transversality 
condition has exactly k terms. This improves the results of Il2ll . 
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